Urban Traffic Control Using Adjusted Reinforcement Learning in a Multi-agent System
نویسندگان
چکیده
Dynamism, continuous changes of states and the necessity to respond quickly are the specific characteristics of the environment in a traffic control system. Proposing an appropriate and flexible strategy to meet the existing requirements is always an important issue in traffic control. This study presents an adaptive approach to control urban traffic using multi-agent systems and a reinforcement learning augmented by an adjusting pre-learning stage. In this approach, the agent primarily uses some statistical traffic data and then uses traffic engineering theories for computing appropriate values of the traffic parameters. Having these primary values, the agents start the reinforcement learning based on the basic calculated information. The proposed approach, at first finds the approximate optimal zone for traffic parameters based on traffic engineering theories. Then using an appropriate reinforcement learning, it tries to exploit the best point according to different conditions. This approach was implemented on a network in traffic simulator software. The network was composed of six four phased intersections and 17 two lane streets. In the simulation, pedestrians were not considered in the system. The load of the network is defined in terms of Origin-Destination matrices whose entries represent the number of trips from an origin to a destination as a function of time. The simulation ran for five hours and an average traffic volume was used. According to the simulation results, the proposed approach behaved adaptively in different conditions and had better performance than the theory-based fixed-time control.
منابع مشابه
User-based Vehicle Route Guidance in Urban Networks Based on Intelligent Multi Agents Systems and the ANT-Q Algorithm
Guiding vehicles to their destination under dynamic traffic conditions is an important topic in the field of Intelligent Transportation Systems (ITS). Nowadays, many complex systems can be controlled by using multi agent systems. Adaptation with the current condition is an important feature of the agents. In this research, formulation of dynamic guidance for vehicles has been investigated based...
متن کاملMicroscopic Urban Traffic Simulation with Multi-Agent System
Computer traffic simulation is important for making new traffic control and traffic guidance strategies. Microscopic traffic simulators can model traffic flow in a realistic manner. In this paper, a framework of a microscopic urban traffic simulator based on Multi-Agent System is introduced. The traffic light control agent and the vehicledriver agent, which are the most important agents, are de...
متن کاملReal-Time Coordinated Signal Control Using Agents with Online Reinforcement Learning
This paper introduces a multi-agent architecture for real-time coordinated signal control in an urban traffic network. The multi-agent architecture consists of three hierarchical layers of controller agents: intersection, zone and regional controllers. Each controller agent is implemented by applying artificial intelligence concepts namely fuzzy logic, neural network and evolutionary algorithm....
متن کاملMultiagent Reinforcement Learning and Coordination for Urban Traffic Control using Coordination Graphs and Max-plus Master’s Thesis Artificial Intelligence Specialization Intelligent Systems
متن کامل
Voltage Coordination of FACTS Devices in Power Systems Using RL-Based Multi-Agent Systems
This paper describes how multi-agent system technology can be used as the underpinning platform for voltage control in power systems. In this study, some FACTS (flexible AC transmission systems) devices are properly designed to coordinate their decisions and actions in order to provide a coordinated secondary voltage control mechanism based on multi-agent theory. Each device here is modeled as ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2013